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ABSTRACT 


In this paper, we present an analysis of a multigrid method for nonsymmetric and/or indefinite elliptic 
problems. In this multigrid method various types of smoothers may be used. One type of smoother which we 
consider is defined in terms of an associated symmetric problem and includes point and line, Jacobi and Gauss- 
Seidel iterations. We also study smoothers based entirely on the original operator. One is based on the normal 
form, that is, the product of the operator and its transpose. Other smoothers studied include point and line, 
Jacobi and Gauss-Seidel. We show that the uniform estimates of (ref. 6) for symmetric positive definite problems 
carry over to these algorithms. More precisely, the multigrid iteration for the nonsymmetric and/or indefinite 
problem is shown to converge at a uniform rate provided that the coarsest grid in the multilevel iteration is 
sufficiently fine (but not depending on the number of multigrid levels). 


L INTRODUCTION 


The purpose of this paper is to study certain multigrid methods for second order elliptic boundary value 
problems including problems which may be nonsymmetric and/or indefinite. Multigrid methods are among 
the most efficient methods available for solving the discrete equations associated with approximate solutions of 
elliptic partial differential equations. Since their introduction by Fedorenko (ref. 15), there has been intensive 
research toward the mathematical understanding of such methods. The reader is referred to (ref. 19), (ref. 17) and 
(ref. 3) and the bibliographies therein. Most of these works concern symmetric, positive definite elliptic problems 
although a few consider nonsymmetric and/or indefinite problems. In particular, (ref. l),(ref. 18), (ref. 10) and 
(ref. 24) deal with such multigrid algorithms and are most closely related to the subject of this paper. All of these 
papers share the requirement that the coarse grid be sufficiently fine. We shall briefly describe their contents. 
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The paper by Bank (ref. 1) derives uniform convergence estimates for the W-cycle multigrid iteration with 
both a standard Jacobi smoother and a smoother which uses the operator times its adjoint. In each case, a 
sufficient number of smoothings are required and a sufficiently fine coarse grid, depending on the number of 
smoothings, is needed. Some regularity for the elliptic partial differential equation was also required. 

Mandel studied the V - cycle iteration and showed that it was effective with only one smoothing, and a 
sufficiently fine coarse grid. His result requires that the underlying partial differential equation satisfies the “full 
elliptic regularity” hypothesis and generalizes the results of Braess and Hackbusch (ref. 2) for the symmetric 
positive definite problem. 

Bramble, Pasciak and Xu (ref. 10) studied the symmetric smoother introduced by Bank and showed that 
the W-cycle and variable V-cycle worked without making the undesirable requirement of “sufficiently many 
smoothings” . Somewhat more than minimal regularity was needed. 

In (ref. 24), Wang showed that, for the standard V-cycle with one smoothing, the “reduction factor” for the 
iteration error was bounded by 1 — CjJ 4- C\h\ where J is the number of levels, h\ is the size of the coarsest grid 
and C and C\ are constants. This estimate deteriorates with the number of levels and will be less than one only if 
the coarse grid is subsequently finer as the number of levels increases. Minimal elliptic regularity was assumed. 

In this paper uniform iterative convergence estimates for V-cycle multigrid methods applied to nonsymmetric 
and/or indefinite problems are proved under rather weak assumptions (e.g., the domain need not be convex). 
Uniform estimates were shown to hold in (ref. 6) and (ref. 8) for the V-cycle with one smoothing step in 
the symmetric positive definite case under such hypotheses. We show that these results carry over to the 
nonsymmetric and/or indefinite case for a variety of smoothers. The coarse grid must be fine enough but need 
not depend on the number of levels J. Such a condition seems unavoidable since, in many cases, it is needed even 
for the approximate problem to make sense. 

In recent years, some other techniques have been proposed to handle the nonsymmetric indefinite case. One 
approach in (ref. 14), (ref. 4) and (ref. 7) is to precondition with a symmetric operator and then solve certain 
normal equations by the conjugate gradient method. One possible advantage of such a method is that some 
nonsymmetric problems which are not “compact perturbations” of symmetric ones may be treated. Of course, the 
usual normal equations may be formed and then preconditioned (cf. (ref. 7) and (ref. 20)); this approach seems 
to be rather restrictive in that good preconditioners may be difficult to construct. Other recent approaches have 
included Schwarz type methods (ref. 12) and two-level methods in which a “coarse space is introduced to reduce 
the problem to one with a positive definite symmetric part (cf. (ref. 4), (ref. 13) and (ref. 25)). 

The remainder of the paper is organized as follows: In Section 2, we describe a model problem and introduce 
the multigrid method. In Section 3, smoothers based on the symmetric problem (and used in our nonsymmetric 
and/or indefinite applications) are defined and the relevant properties which they satisfy are stated. Section 
4 develops smoothers based on the original problem. The main results of the paper, which provide iterative 
convergence rates for the multigrid algorithms with the smoothers of Sections 3 and 4, are given in Section 5. 

2. THE PROBLEM AND MULTIGRID ALGORITHM. 


We set up the model nonsymmetric problem and the simplest multigrid algorithm in this section. We consider, 
for simplicity, the Dirichlet problem in two spatial dimensions approximated by piecewise linear finite elements 
on a quasi-uniform mesh. The multigrid convergence results hold for many extensions and generalizations as 
discussed at the end of Section 5. 
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We consider as our model problem the following second order elliptic equation with homogeneous boundary 
conditions. 


( 2 . 1 ) 



au = f 


u = 0 


in fl, 
on Sfi, 


where fl is a polygonal domain (possibly nonconvex) in R 2 and {a,;(x)} is bounded symmetric, and uniformly 
positive definite for x € ft. We assume that is in the Sobolev space W£(f2) for p > 2/7 (see, (ref. 16) for 
the definition of W p 7 (Q)). Further, we assume that b, is continuously differentiable on Q and that |a| is bounded 
Finally, we assume that the solution of (2.1) exists. 


Let jy J (n) denote the Sobolev space of order one on fi (cf., (ref. 16)) and let Ffd(fl) denote those functions in 
/f*(n) whose trace vanish on dCl. For v , w E Hq(£1), define 


( 2 . 2 ) 




avw dx. 


The solution it of (2.1) satisfies 

(2.3) A(u, v ) = (/, v) for all v € 

where (•,•) denotes the inner product in L 2 (fi). 

For the analysis, we introduce a symmetric positive definite form i(-, •) which has the same second order part 
as j 4(*, •). We define A{- y •) by 

+ i“ vd ‘- 


The difference is denoted by 

D(u, v ) = A{u, u) - A(u, v). 

The form D ( •, •) satisfies the inequalities 

(2.4) |Z?(u,ti)| < Ctlwlli Ill'll and |£»(u,v)| < C||u|| ||u||i . 

Here ||-||, and || || denote the norms in H l (Q) and L 2 (Q) respectively. The second inequality above follows 
from integration by parts. Here and throughout the paper, c or C, with or without subscript, will denote a 
generic positive constant. These constants can take on different values in different occurrences but will always be 
independent of the mesh size and the number of levels in multigrid algorithms. 

By the assumptions on the coefficients appearing in the definition of A(-, •), it follows that the norm A(v, v)^ 2 
for v 6 H l (Q) is equivalent to the norm on Thus, we take 

IHIi = i(®,«) 1/2 - 


We develop a sequence of nested triangulations of Q in the usual way. We assume that a coarse triangulation 
{ r *} of ft is given. Successively finer triangulations {r,' n } for m > 1 are defined by subdividing each triangle 
(in a coarser triangulation) into four by connecting the midpoints of the edges. The mesh size of {rj} will be 
denoted to be di and can be taken to be the diameter of the largest triangle. By similarity, the mesh size of {r^} 

is 2 1_m d 1 . 

For theoretical and practical purposes, the coarsest grid in the multilevel algorithms must be sufficiently fine. 
In practice, however, the coarse grid is still considerably coarser than the solution grid. Let L and J be greater 



than or equal to one and set Af*, for k = 1, to be the functions which are piecewise linear with respect to 
the triangulation {t£ + x }, continuous on H and vanish on Sfl. Since the triangulations are nested, it follows that 


M1CM2C...C Mj. 

The space M* has a mesh size of A* = 2 1 ~ L ~ k di — 2 1 ~ k hi. 

Fix k in {1, 2, . . .}. Let us temporarily assume that for every u E Af*, 

(2.5) j4(u,u) = 0 for all t; 6 Af* implies u = 0. - ; . ’ '' 

This assumption immediately implies the existence and uniqueness of solutions to problems of the form: Given a 
linear functional F(-) defined on Af*, find u E Af * satisfying 

A(u i <f>) = F(<f>) for all <f> E M*. 

In particular, the projection operator P* : P^fi) 1— ► Af* satisfying 

A(Pi c u i r) = A(u } v) for all v € Af*, 


is well defined. 

Clearly, if (2.2) has a positive definite symmetric part then (2.5) holds. More generally, if solutions of (2.1) 
satisfy regularity estimates of the form 


(2-6) Nil*. < C\\f\\- 1+a , 

then, it is well known (cf., (ref. 22)) that there exists a constant ho such that for ft* < fto, (2.5) holds and 
furthermore 


(2*7) ll(/-ft)u||<cftJ||(J-ft)ti|| 1 . 

and finally, 

(2.8) ll-PHli <C|H|j. 

Even if regularity estimates of the form of (2.6) are not known to hold, then (2.5) is known from a recent result by 
Schatz and Wang (ref. 23). 

Lemma 2.1 (ref. 23). There exists an fto such that (2.5) holds for ft* < fto- Moreover, given e > 0, there exists 
an fto(0 > 0 such that for all A* E (0, fto], (2.8) holds and 

(2-9) \\(I-P k )u\\<€\\(I-P k )u\U. 


Remark 2.1 . The above e will appear in our subsequent analysis. We note that e can be taken arbitrarily small. 
However, L will be taken large enough so that (2.5), (2.8) and (2.9) hold. Thus, the coarse grid size (i.e., L) for 
any estimate in which e appears will depend on e. 


In our analysis, we shall use the orthogonal projectors P* : PoW M* and Q* : L 2 (Q) !—► M* which, 
respectively, denote the elliptic projection corresponding to A( «, •) and the L 2 (Q) projection. These are defined by 

A(PkU , v) = A(u } v) for all v E AT*, 
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and 

(<3*u, t>) = (u, v) for all t; E Af* . 


The multigrid algorithms will be defined in terms of an additional inner product (•, •)* on Af*Af*. Examples of 
this inner product in our applications will be given in the next section. Additional operators are defined in terms 
of this inner product as follows: For each k ) define A* : Af* — ► Af* and A* : Af* — ► Af* by 

(A*u, v)k = A(ti, v) for all v E AT*, 

and 

(A*u, t>)* = A(u, v) for all v E Af*. 

Finally, the restriction operator P%-\ • Af* Af*_i is defined by 

(Pk-i u > v)*-i = (u, v)* for all v E Af*_i. 


We seek the solution of 

(2.10) A(u i v) = (f i u), for all v € Mj. 
This can be rewritten in the above notation as 

(2.11) Aju — Qjf. 


We describe the simplest V-cycle multigrid algorithm for iteratively computing the solution u of (2.3). Given 
an initial iterate uq € Af j , we define a sequence approximating u by 

(2.12) Uf+i = 

Here Mgj(*, •) is a map of MjMj into Mj and is defined as follows. 

Definition MG. Set Mgi(v,w) = A\ l w. Let k > 1 and v } xv be in Af*. Assuming that M < g*_ ] (* } ») has been 
defined, we define Afg*(i>,u;) by: 

(1) x* = v + Rk(w - A*v). 

(2) Mg k (v> it;) = x* + q, where q is defined by 


q = M gk _ 1 (Q,Pl 1 (w-A k x k )). 


Here iZ* : Af* !-► Af* is a linear smoothing operator. Note that in this V-cycle, we smooth only as we proceed 
to coarser grids. 

In Section 3, we define iZ* in terms of smoothing operators defined for the form A(-, •). Specifically, the 
smoothing procedure for the symmetric problem will be denoted R k : Af* Af* and we set iZ* = .R*. In Section 4, 
we consider smoothers which are directly defined in terms of the original operator A*. 

A straightforward mathematical induction argument shows that Mgj(-, •) is a linear map from MjMj into Afj. 
Moreover, the scheme is consistent in the sense that v = Mg j(v,Ajv) for all v E Afj. It easily follows that the 
linear operator E = Mgj(-,0) is the error reduction operator for (2.12), that is 

u - Ti,-+l = E(u - Ui). 


47 


Let Tk = RkAkPk for ib > 1 and set Ti = Pi. Using the facts that Pk-\Ak = AkiPk-i and Pk-iPk — Pk-i and 
Definition MG, a straightforward manipulation gives that for k > 1 and any u £ Mj, 

u - Mg*(0, AkPkv) = (I - Tk)u - Mg t _i(0, Ak-iPk-i(I - ?*)«)• 

Let EkU = u - Mg t (0, AtPjtu). In terms of Ek, the above identity is the same as 

Ek = Ek-i(I-Tk). 


Moreover, by consistency, E = Ej and hence 

(2.13) E = (I-T 1 )(I-T 2 )--(I-Tj). 

The product representation of the error operator given above will be a fundamental ingredient in the convergence 
analysis presented in Section 4. Similar representations in the case of multigrid algorithms for symmetric problems 
were given in (ref. 9). 

The above algorithm is a special case of more general multigrid algorithms in that we only use pre-smoothing. 
Alternatively, we could define an algorithm with just post-smoothing or both pre- and post-smoothing. The 
analysis of these algorithms is similar to that above and will not be presented. 

Often algorithms with more than one smoothing are considered (ref. 3), (ref. 17), (ref. 19). This is not advised 
in the above algorithm since the smoothing iteration is generally unstable. 


3. SMOOTHERS BASED ON THE SYMMETRIC PROBLEM. 

In this section, we consider smoothers which are based on the symmetric problem. The symmetric smoother 
will be denoted by Rk- We state a number of abstract conditions concerning these smoothing operators. We 
then give three examples of smoothing procedures which satisfy these assumptions. In Section 5, we provide 
convergence estimates for multigrid algorithms with Rk = Rk in Definition MG. 

The first two conditions are standard assumptions used in earlier multigrid analyses. For k > 1, let Kk = 

I - R k A k (defined on M k ) and 7* = RkA k Pk (defined on Mj). We assume that: 

(1) There is a constant Cr such that 

(C.l) ~ u )*> * or a11 u G Mk ' 

where Rk = (I-K{kk)A k l and \ k is the largest eigenvalue of A k . Here and in the remainder of this paper, 
* denotes the adjoint with respect to the inner product A(-, •). 

(2) There is a constant 6 <2 not depending on k satisfying 

(C.2) A(fkv,tkv) < 0A(TkV, d) for all v 6 Mk. 

Provided that (C.2) holds, (C.l) is equivalent to 

(3.1) < C(RkU, u) k , for all ti e M k . 

When Rk is symmetric with respect to (•,•)*, (C.2) states that the norm of Tit is less than or equal to 6. Even in 
the case of non-symmetric i?*, (C.2) implies stability of (I — Ti). In fact, for any w € (C.2) implies that 

A((I - f k )w, (/ - Tk)w) = A{w y w) - 2A(T k w y w) + A{f k w y T k w) 

(3 ‘ 2 ^ < A{w , w) - (2 - 6)A(TkW, w) < A{w, w). 
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The final condition is that for Jfc > 1, there exists a constant C satisfying 
(C.3) (fku,fku)k < C\t l A(TkU, u) for all u e M*. 

A simple change of variable shows that (C.3) is the same as 

(RkV, Rkv)k < CX^{RkV,v)k for all t; e Af*. 

In the case when Rk is symmetric, this is equivalent to 

(3.3) {RkV, v)k < CX^ l {v, v)k for all v € Mk 

and is the opposite inequality of (3.1). Note that both (C.2) and (C.3) hold on Mj. 

Remark 3.1. If Conditions (C.1)-(C.3) hold for a smoother Rk then they hold for its adjoint R\ with respect to 
the inner product (•, •)*. This means that (C.l) holds for Rk = (/ — KkKk)A k 1 and that (C.2) and (C.3) hold 
with replacing T t . In the case of (C.2) and (C.3), the corresponding inequalities hold with the same constants 
as those appearing in the original inequalities. 

Example 1. The first example of a smoother is the operator 

Rk = X^I 

where I denotes the identity operator on Mk and Xk < Xk < CXk- In this case, (3.1) holds with C = A*/A*, (C.2) 
holds with 9 = 1 and (3.3) holds with C = A* /A*. To avoid the inversion of L 2 Gram matrices in the multigrid 
algorithm, we use the inner product 

(3.4) (u, v)k = h 2 k ^2 «(*<)»(*»■)■ 

I 

Here the sum is taken over all nodes x, of the subspace A/jt . Note that (•, *)jt is uniformly (independent of k ) 
equivalent to (•, •) on Mjt. 

The remaining smoothers correspond to Jacobi and Gauss-Seidel, point and line iteration methods. We shall 
present these smoothers in terms of subspace decompositions. Specifically, we write 

i 

(3.5) M k = 

1=1 

where is the one dimensional subspace spanned by the nodal basis function <f>[ or the subspace spanned by 
the nodal basis functions along a line. The number of such spaces / = l(k) will often depend on k. These spaces 
satisfy the following inequality. 

(3.6) |M| < Chk ||v||i for all v G M[. 

Example 2 . For the second example, we consider the additive smoother defined by 

/ 

(3.7) Rk = 7^2Ak}Qk,i. 

i= 1 


Here Ak,i : M' k M' k is the defined by 

(i*,,v. x)k = A(v, x) for all x € M' k 
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and Q*,; : Mk — 1 ► M{ is the projection onto M f k with respect to the inner product (•, ‘)*. The constant 7 is a scaling 
factor which is chosen to ensure that (C.2) is satisfied (see, e.g., (ref. 11), (ref. 5)). Note that Rk is symmetric 
with respect to the inner product («, •)*. In addition, (3.1) and (3.3) are shown to hold in (ref. 11) with point 
Jacobi. When the subspaces M[ are defined in terms of lines, (3.1) was proved in (ref. 5). The estimate (3.3) 
easily follows in the line case using the support properties of the basis functions and (3.6). For this example, we 
take (•, •)* = (•, •) for all k. 


Example 3 . We next consider the multiplicative smoother. Given / £ M*, we define Rk by 

(1) Set vo = 0 £ Mk. 

(2) Define t;,*, for t = 1, . . . , 1, by 

Vi = Vi -1 + Ak)Qk t i(f - AkVi-i). 

(3) Set R k f = Vb 

Conditions (C.l) and (C.2) are known for this operator (see, e.g., (ref. 5)). The next lemma shows that (C.3) 
holds for this choice of Rk . For this case, we also take (*, •)* = (♦, *) for all k. 

Lemma 3.1. (C.3) holds when Rk is defined to be the multiplicative smoother of Exejnple 3. 

Proof. The proof uses the techniques for analyzing smoothers presented in (ref. 5). Fix h > 1 and let 

(3.8) = Pt)(l - Pi' 1 ) • (/- Pk) 

where P* denotes the A(*, •) projection onto Ml and Sq = I. Note that (I — T*) = £1 and £,_i = £, 4- P*£-i . Hence 

; 

f k = i-£, = ^2Pi£ i - 1 

i—i 

and for every u £ Mk, (cf., (ref. 5)) 

A((2I - t k )u>fku) = A(u t u) - A(£iuJiu) 

1 

= J^A(Pk£i-iu,£i-iu)- 
i - 1 

Since h\ < cA* 1 , the proof of the lemma will be complete if we can show that 

(3.9) (ft If, ftu) < chlJ^A(Pl£i-iu,£i-iu). 

i-i - 


Expanding the left hand side of (3.9) gives 

/ 1 

(3.10) (Ttu.ftu) = ££(#£-!«, PtSj-iu). 

r=l j=l 

Because of the support properties of {<^}, the subspaces {M/} satisfy a limited interaction property in that for 
every i } the number of subspaces j for which (t? 1 , v J ) / 0, with v f £ Ml and v } £ M[ is bounded by a fixed 
constant no not depending on it or 1. Lemma 3,1 of (ref. 5) implies that the double sum of (3.10) can be bounded 
by no times its diagonal, i.e, 

/ 

(3.11) ( T k u,f k u ) < no ^(Plii-iU, P^,-iu). 

1=1 
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Applying (3.6) gives 

(312) (A'4-1«, H&- 1«) < ChlAiPiii-iU, ii-iu). 

Combining (3.11) and (3.12) proves (3.9). This completes the proof of the lemma. 

Remark 3.2. The same analysis could be used for successive overrelaxation type iteration. In that case, 

= pPl)(i - M' _1 ) •••(/- PPl) 

where /3 6 (0, 2) is the relaxation parameter. 

4. SMOOTHERS BASED ON A k . 

In this section, we consider smoothing operators i?* which are defined directly in terms of the nonsymmetric 
and/or indefinite operator A*. The first smoother is one that was originally analyzed in (ref. 1) and subsequently 
studied in (ref. 10). 

Example 4 • For our first example of a smoother based on Ak } we consider Rk defined by 

Rk = x; 2 aI 

Here, A\ is the adjoint of Ak with respect to the inner product (•, •)* and A* is as in Example 1. A possible 
motivation for such a choice is that, on Mk ) the iteration 

t/ = t/“* + X k 2 A[(f — AkV*~ l ) 

is stable in the norm (•, -)j^ 2 provided that A l is greater than or equal to half the largest eigenvalue of A\Ak< 

Example 5. This example is closely related to the second example of the previous section. As in that example, we 
define the line or point subspaces {M' k } for i = 1, . . . , /. Note that the form A(-, •) satisfies a Garding inequality 



cii4(u, u) - c ||u|| 2 < A(u } u) 

for all u G #o(^)- 

Consequently, by (3.6), 

(ci - Chl)A(u } u) < A(u, u) 

for all u E Mj. 

We will assume that h% 

is sufficiently small so that 


(4.1) 

Ch\ < c i/ 2 - 



This means that A(-, *) restricted to M £ has a positive definite symmetric part. Hence, the projector P k : Mk 
Mj. satisfying 

A{P[v ) w) = A(v , tu) for all w E Mj 

is well defined and satisfies 

( 4 - 2 ) || p * u |li < C'lMii.n* • 

The second norm is taken only over the subdomain Cl k which is the set of points of Cl where the functions in M' k 
are nonzero. In addition, the operator Ak,i : Mj, t— > M’ k defined by 

(AkjV, w)k = A(v, w) for all v,w e M[, 
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is invertible. We set Rk by 


i 

Rk = y^A;}Qk,i. 

i-1 

We choose 7 as in Example 2 so that the symmetric smoother defined by (3.7) satisfies (C.2). 

Example 6. Our final example is that of Gauss-Seidel directly applied to the nonsymmetric/indefinite equations. 
We assume that the subspaces {M' k } satisfy the conditions of the previous example. The block Gauss-Seidel 
algorithm (based on A*) is given as follows: 

( 1 ) Set vo = 0 € Mk- . . 

(2) Define v,, for i = 1, . . . , l, by _ 

Vj = t>i_i + A k ~ Atv.-i)- 


(3) Set Rkf = vi. 


5 . ANALYSIS OF THE MULTIGRID ITERATION (2.12). 


We provide an analysis of the multigrid iteration (2.12) in this section. This analysis is based on the product 
representation of the error operator (2.13). All of the analysis of this section is based on perturbation from the 
uniform convergence estimates for multigrid applied to symmetric problems. 

We start by stating a result from (ref. 6 ) estimating the rate of convergence for the multigrid algorithm applied 
to the symmetric problem. Specifically, we replace A k by A k and R k by R k in Definition MG. Set T\ — P\. 

From the earlier discussion, the error operator associated with this iteration applied to finding a solution for the 
symmetric problem 

Aju-Qjf 

is given by E = Ej where 

(5.1) r* = (/-Ti)(7-f 2 ) •••(/- f t ). 

We then have the following theorem. 


Theorem 5.1 (ref. 6 ). For Jfc > 1, let R k satisfy (C.l) and (C.2). Under the assumptions on the domain Q and 
the coefficients of (2.1) given in Section 2, there exists a positive constant 6 < 1 not depending on J such that 

A(Eju, Eju) < 5 2 A(u,u) for all u e Mj. 

To analyze the multigrid algorithms using the smoothers of Section 3, we use the perturbation operator 

Z k = T k — T k . 

We note that for any u, v € Mj, for k > 1, 

(5.2) A(Z k u,v) = D(u,T k v). 

Indeed, by definition, . „ ... 

A(T k u,v) = (T k u,A k Pkv)k = ( A k P k u,R k AkPkv)k 

= (A k PkU,T[v)k = A(PkU,f[v) 

= A(u,T(v) = A(u,f£v) + D(u,T k v). 
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The equality (5.2) immediately follows. 
To handle the case of k = 1, we have 


(5.3) A(Ziu, v) = D((I - fi)u, Aw). 

In fact, by definition, 

A(Piu,v) = A(P 1 u f P 1 v) 

= A(u , Aw) - D{P x u ) Aw) 

= A(Piu ) v) + D((I — Pi)ti, Aw). 

The following theorem provides an estimate for the multigrid algorithm when the smoothers of Section 3 are used. 


Theorem 5.2. Let Rk = Rk and assume that (C.1)-(C.3) hold. Given c > 0, there exists an ho > 0 such that for 

hi < ho, 

A(Eu ) Eu ) < <5 2 A(u, it) for all u G Af>, 

for 5 = 5 -f c(hi 4* c). Here 5 is less than one (independently of J) and is given by Theorem 5.1. 


Proof. For an arbitrary operator O : Mj »-► Mj } let ||0||^ denote its operator norm, i.e., 

||0|h= sup -T A{° U * V ) , 

" IU A(u, u)>/U(u, u)J/2 


Applying (2.4), (2.9) and (2.8) to (5.3) gives 

\MZ i«, v)\<Ct ||(J - Pi)u||j IMIj < Cc Hli ||v||j . 

This means that the operator norm of Z\ is bounded by Cc. Since the operator norm of (I — A) is less than or 
equal to one, the triangle inequality implies that the operator norm of (7 — Pi) = (7 — A — Z\) is bounded by 
1 + Cc. 

For k > 1, applying (2.4), (C.3), Remark 3.1, and (3.2) to (5.2) gives 

\A(Z k u, v)| < ch k Hull, A(f k v, v ) lf2 
< chk Hull! IMIj , 

i.e., the operator norm of Z* is bounded by ch*. Since, by (3.2), the operator norm of (7 — Tjt) is less than or equal 
to one, the triangle inequality implies that the operator norm of (7 — T*) = (7 — — Zjt) is less than or equal to 

1 + chk. Hence, it follows that 

* 

m\h<{u-c ( )Yi(i+ch t) <c. 

?=2 

It is immediate from the definitions that 

(5.4) E k -E k = (E k - 1 - E k -i)(I - A) - E k -iZ k . 

By (3.2) and the above estimates, for fc > 1, 


(5.5) 


II Ek - Ek IU < P*-i - E k -ih\\I ~ T k IU + \\Ek-i\\ A \\Zk\\ X 

< WEk-i-Ek-ilh + Chk. 
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Repetitively applying (5.5) and using 

1 1 -Ei “ EilU = H Z ilU ^ Ce 

gives that 

j 

|| Ej - Ej\\x < Ce + cY^hk < c{hi -he). 
k = 2 

The theorem follows from the triangle inequality and Theorem 5.1. 

Remark 5.1. Note that e can be made arbitrarily small by taking \ small enough. Consequently, Theorem 5.2 
shows that the multigrid iteration converges with a rate which is independent of J provided that the coarse grid is 
fine enough. The coarse grid mesh size can also be taken to be independent of J. 

We next consider the case of Example 4. For this example, we consider first the multigrid algorithm for the 
symmetric problem which uses 

( 5 . 6 ) Rk = \ 2 A k 

as a smoother. From the discussion in Section 2, the iteration (2.12) with Rk (given by (5.6)) and Ak replacing, 
respectively, Rk and Ak in Definition MG, gives rise to the error operator given by (5.1) where, as above, for 
k > 1, Tit = RkAkPk- The smoother (5.6) does not satisfy (C.l) and so the first step in the analysis of the 
nonsymmetric and/or indefinite example is to provide a uniform estimate for Ej given by (5.1). Such an estimate 
is provided in the following theorem. Its proof is given in the appendix. 

Theorem 5.3. Let Ej be given by (5.1) where Tk — RkAkPk and Rk is defined by (5.6). Then, 

A(Eju , Eju) < 6 2 A(u , u) for a llu£ Mj. 

Here 6 is less that one and independent of J. 

We can now prove the convergence estimate for multigrid applied to (2.1) using the smoother of Example 4. 

Theorem 5.4. Let Rk be defined by Example 4. Given e > 0, there exists an ho > 0 such that for h\ < ho, 

A(Eu, Eu) < 6 2 A(u, u ) for a 11 u £ Mj, 

for 6 = 6 + c(hi + e). Here 6 is less than one (independently of J) and is given by Theorem 5.3. 

Proof. For k > 1, we consider the perturbation operator 

Z k = T k -T k = \?{A l k A k P k - A\P k ). 

Clearly, 

(5.7) Z* = K 2 {A l MkPk ~ A k P k ) + (4 - A k )A k P k \. 

As in (5.2), 

X k l A((A k P k - A k P k )u,v) = \?D(u,A k P k v) 

from which it follows using (2.4) that 

||4 1 (-''UA ~ A k P k )\\ k < ch k . 

A similar argument shows that 

|| \- k '(A l k -A k )P k \\ x <ch k . 


| 
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It is not difficult to show that 

II4IU < eh- 

Combining the above estimates with (5.7) gives 

mb < iixMiuiiVMta - 4A)iu 

+ HV(4 - ^Auia^Aiia < ch k . 

The remainder of the proof is exactly the same as that of Theorem 5.2. This completes the proof of the theorem. 

We next consider the case of Example 5. We use perturbation from the multigrid algorithm for A which uses 
the smoother R * defined by Example 2. Theorem 5.1 provides a uniform estimate for the operator norm of Ej. 

Theorem 5*5. Let R k be defined by Example 5. Given e > 0, there exists an ho > 0 such that for h\ < ho, 

A{Eu ) Eu) < 6 2 A(u 1 u) for all u € Mj, 

for 6 = 6 + c(h\ + e). Here 6 is less than one (independently of J) and is given by Theorem 5.1 applied to Rk 
defined in Example 2. 


Proof. For this case, the perturbation operator Zk is given by 

i 


As in (5.3), 


Zk = 7 ^-^)- 

i=I 

M(H - HM = d((i - Pi)u,p<v). 


Applying (2.4), (3.6) and (4.2) gives 

(5.8) A((Pt - P£)u, v) < ch k Nl lin . Mixts, 

and hence 


A(Z k u, v) < ch k XI ll u lli,n( ■ 


t-1 

Using the limited overlap properties of the domains, Q l k gives 

\\Zk\\x < ch k . 

The remainder of the proof of the theorem is exactly the same as that given in the proof of Theorem 5.2. 

We finally consider the case of Example 6. We use perturbation from the multigrid algorithm for A which uses 
the smoother R k defined by Example 3. Theorem 5.1 provides a uniform estimate for the operator norm of Ej . 


Theorem 5.6. Let Rk be defined by Example 6. Given e > 0, there exists an ho > 0 such that for h\ < ho, 

A(Eii, Eu) < S 2 A(u , u ) for all u € Mj, 

for 6 = 6 -f c(hi + e). Here 6 is less than one (independently of J) and is given by Theorem 5.1 applied with Rk 
defined as in Example 3. 


Proof. The perturbation operator for this example is 

Z k = Tk-T k = 8i- £i 
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where Si is given by (3.8) and 




with So = / . As in (5.4), 

£-£ = (/- Pi)(£i - 1 - ft-i) - (A' - 

Since the last two terms are orthogonal with respect to A(«, •) we have that 

ika - ft)« il| = iia - A')(A-i - + ik>* - 

Because of (5.8) and the fact that the operator norm of ( I - P' k ) is bounded by one, it follows that 

ll(£ " £)< < ll(A-i " *-iHl + Ch 2 k ||ft Hfc. . 

Summing over i } since So = S o = /, we obtain 

i 

(5.9) \\(ii - &)u\\\ < C&j2||6-I«||; i n. . 

»=] 

We shall show that 

(5.10) T, ll^-i u lli,ni < 

By the arithmetic-geometric mean inequality, the definition Si and the limited interaction property (see (3.10) and 
above) it follows that 


»=i 


(5.11) 


i,n‘ 


y^ll^i-iu|li.n; < ayiNlfiq +*y\\» 

i - 1 i-l 

<ciHii+2x:||£pr^-i« 

i=l ||m=l 

< c{\m\ + y* \\ p rs*-M\is>i ) 

m=l »=j 

scdMiA+En^m-Hii). 

m=l 

In order to estimate the last term on the right of (5.11) we write 


(5.12) 

Now by (5.8) 
(5.13) 


\\P?£ m -M\\ = A(P?e m - X u,P?£ m -iu) 


— A[{£m- 1 £m)Vt (£m— 1 fm)w) 

= A ((£ m - ] — £m)u, (£m- 1 + £m) u ) — 2 j4(P|. £ m -i‘U, £ m u) 

— A(£m-lU, £m— iu) A( t £ m U f £,n u) 

— 2A(P k m £ m - 1 u, (I - P k m )£, „_,)«). 


A(P k m £ m -,u, (I - P?)£ m - iu) = A{P?£, »_,u, (P t m - P t m Km-i)ti) 

<C/> t ||Pr^m- 1 ti|U||fm- 1 «|| 1 , nr . 
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Hence, combining (5.12) and (5.13), we have 

< C[A(€ m - 1«, € m -iu) - A{£ m \i } £ m u)] + Ch\ ||£m-HI?,n r • 

Summing over m we conclude that 

£ || < C\W\+Chl£\\£ m -lu\\l^ . 

m=l m=1 

This together with (5.11) yields (5.10) when h k is small enough. Finally, we obtain from (5.10) and (5.9) that for 

Jfc> 1, 

m\ A <ch k . 

The remainder of the proof of this theorem is the same as that of Theorem 5.2. 

Remark 5.2. The same analysis could be used for successive overrelaxation type iteration. In that case, 

£, = (!- pp' k )(i - pri~ l ) •••(/- 0Pl) 


where /? G (0,2) is the relaxation parameter. 


Remark 5.3. Many extensions and generalizations of the techniques given above are possible. These techniques 
lead to uniform estimates for multigrid iteration methods for solving nonsymmetric and/or indefinite problems for 
the following applications. 

(1) Approximations using higher order nodal finite element spaces. 

(2) Three dimensional problems. 

(3) Problems with discontinuous coefficients as discussed in (ref. 6). 

(4) More general boundary conditions. 

(5) Problems with local mesh refinement as described in (ref. 11). 

(6) Finite element approximation of problems on domains with nonpolygonal boundaries as discussed in 
(ref. 6). 


In addition, the perturbation analysis given above can be combined with results for additive multilevel 
algorithms, for example, Theorem 3.1 of (ref. 6). This leads to new estimates for additive multilevel 
preconditioning iterations applied to indefinite and nonsymmetric problems. Provided that the coarse grid is 
sufficiently fine, the operator 

p = X> 

*=i 

has a uniformly (independent of J) positive definite symmetric part with respect to the inner product i(-, •) and 
has a uniformly bounded operator norm. These results extend to all of the applications discussed in Remark 5.3. 


6. APPENDIX 


We provide a proof of Theorem 5.3 in this appendix. We will apply the analysis given in the proof of Theorem 
3.2 of (ref. 6). Note that we cannot directly apply Theorem 3.2 of (ref. 6) since the smoother R k = \ k A k does 
not satisfy (C.l). We note, however, that Theorem 5.3 will follow from the proof of Theorem 3.2 of (ref. 6) if we 
show that (C.2) holds as well as (3.5) and (3.6) of (ref. 6) with T k replaced by T k defined above. Clearly, (C.2) 
holds with 6 = 1. The remaining two inequalities corresponding to (3.5) and (3.6) of (ref. 6) are 

( 6 . 1 ) A(T k v, v) < (Ct) 1 ~') 2 A(v, v) for all v £ Mi, l < k 
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and 


J 

(®*2) A{v, v) < C ^ A(fkV y v) for all v € Mj . 

1 

Here 77 is less than one and independent of A; and Z. 
lYom the definition of A^, we obviously have 

A(TkV,v) < A* 1 v) = A(TkV,v). 

As in (ref. ?), we have set T* = Aj.M*. Inequality (6.1) follows from Lemma 4.2 of (ref. ?). 
Inequality (6.2) can be rewritten, 


(6-3) A(u, u) <C ^A(Piu y u) + A*. 2 . 

To prove this we proceed as follows. Let u € Mj and Q 0 = 0. Then 

J 

A(u, u) = J2 M ( Qk - Qk-\)u) 


k=\ 


(6.4) 


/ m 3 a 2 \ l / 2 / 
< ^(Aw.w) AfcPfcU J ^ 


^(Qi«,Qiw) 

1/2 


+ E **(^(<3* - Qk- 1)«, (Q* - Q*-x)t*)k) 

Jt-2 / 


Now, for fc > 1, 


(4t (0* ~ Qfc-iK (Q* - Qjfc_i)ix)jt 


(4~ 1/2 (Q*-Q*-iK<^ 

(01 0)fc 


= sup 


(»*-9*-.KW*-«w)0)! 

— & up n , 

By well known approximation properties, 

((Qk - Qk-\)ip, (Qk - Qk-i)rp)l /2 < c IICQ* - Qk-i)rp\\ < Ch,k Ml, . 

Combining the above estimates gives 


(6,5) 


j 

MQxu, Q lU ) + £ HUnHQk - Qk-i)u, (Qk - Qk- 

k —2 

< c(a(Q\u,Qiu) + E^* II (<?* — <3jfc-i)u|| 2 

' k=2 

< CA(u,u). 


The last inequality of (6.5) is (4.5) of (ref. ?) and also can be found in (ref. ?). Combining (6.4) and (6.5) proves 
(6.3) and hence completes the proof of the theorem. 
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